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Vocational evaluation is a newly, eroei-ging area of specialization 
within vocational rehabilitation and manpowiir development programs. 
In comon with any new speciality., considerable attention has been fo- 
cused upon the problems of definition and description in order to 
clarify the scope and subject matter of the specialty.. These efforts 
have led to $he identification of a nunber of aiailit-iiriea among voca- 
tional evaluation programs. Those which have been identified 'include 
the use' of ^eal or ^inulatefid work as the basic modality of vocational 
evaluatiofl (I;istitute on * Rehabilitation Services, 1972); the belief 
among ev;4luators that the beat way to determine whether . people can 
functi?^ in a^ jdb situation is to» observe what happens when they arc 
provided with an opportunity to perform in the aituation (Hernimont 
and Campbell, 1968); and several widely held "basic assui^tions" un- 
derlying the practice of vocational evaluation (Pruitt, '1970) . This 
knowledge ia useful in establishing the broad parameters of vocational 
evaluation aervices. However, these similarities do not account for 
the obvious, differences between vocational evaluation programs which 
are .apparent even to casual observers. ^ mean^ of accounting for ♦ 
these operational differences is needed. 

Tht purpose of this paper is to present a way of describing voca- 
tional evaluation programs in terms of their underlying orientations 
toward the process and content of vocational evaluation. There are 
two basic concepts underlying this approach. First, it is assumed 
that the purpose of vocational evaluation is to provide information 
*neci;(ssary^ to resolve vocational decision making problems. That is^ 
individuals ar* typically referred to vocational evaluation from agen- 
cies and programs within the human service delivery system when infor- 
mation relative to the establishment of individual goals and a plan of 
service? .to ^^tain these goals is lacking and cannot be obtained by 
other means (Dunn, et al., 1975; Kom, 1975). Second, vocational 
evaluation programs can differ in their approaches to this information 
problem. Specif^ally, they can differ in terms of proae^e (i.e., in 
the, way in which ififomation generated duping the course of evaluation' 
is handled) as well as^content (i.e., in the subject matter or topic * 
of the infonnation) . . ' 
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In the renainder of this paper, some of the existing orientations 
toward the prooess and content of vocational evaluation are described. 
The ways in which these orientations can be combined to form pari;.lcu- 
lar approaches to voca'tional evaluation are also described, along with 
their 'implications for program' planning, development, and evaluation. 

y Process Orlentaclqns * ^ 

l^he procesf of a vocational evaluation program refers to the way ^ 
in which information generated during the course of evaluation is han- 
dled within the program. Two primary orientations toward process can 
be identified; information gathering and information processing. 

Ihformatim Gathering • ^ 

* In this orientation, information necessary for vocational deci- 
sions is gathered and communicated to others outside of the evaluation 
program by the vocational evali^ator. The evaluation process is clii^i- 
cal in nature and evaluators piay a consultative role basically re- 
stricted to the collection of information related to the vocational 
performance and behavior of evaluees. Although evaluators may be ex- 
pected to analyze their observations to arrive at vocational recommen- 
dations, it is not uncommon to find that evaluators functioning within 
information gathering oriented programs do not have access to the full 
array of available evaluee information which can affect the accuracy 
and meafningf ulness of these recommendations. 

The information gathering orientation commonly does not emphasize 
or use evaludtor-evaluee interaction beyond that necessary to develop 
and maintain an acceptable level of evaluee performance during the 
program. Such things as provision of immediate knowledge of results 
and discussing the implications of evaluee performance and behavior 
during the course of the program are often rejected on the grounds ^ 
that these may unduly influence performance on subsequent j:asks. Ad- 
ditionally, these "counseling" activities are often regarded as being 
outside of the role and duties of evalutors. 

) The benefits of evaluation conducted within the information gath- 
ering orientation depend upon the accuracy and depth of the information 
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obtained, and^the utility of this information in subsequent vocational 
decision making and service planning. Beyc^ this generic goa^l of 
providing accurate and detailed vocational infornation to referring 
sources and others for use in vocational decision making and planning, 
vocational evaluation is nat seen as having direct benefits, particu- 
larly in producing change in evaluees served by the prdgram. 

Information Proce9»tng 

This orientation viewa the -vocational evaluation process as a 
learning and developmental experience in which evaluees can overcome 
deficits in occupational knowledge, self awareness, decision making, 
and planning. In contrast to the role of the evaiuator in the infor- 
mation gathering orientation, evaluators operating within the informa- 
tion processing orientation have an active teaching-counseling role in 
which: (a) evaluees are provided with concrete occupational tasks to 
enable them to gain information about the occupations sampled; (b) 
evaluees are provided with immediate knowledge of results to enable 
them to gain self knowledge of their vocational capabilities and de- 
ficits; and (c) evaluees -are provided with a facilitate ve relationship 
within which decisj^ons can be made and their consequences tested with- 
out incurring the punitive effects of failure. The information proc- 
essing orientation enables the evalue^ ;fo learn effe<:tive ways oif ^ 
processing vocational infornatioh acquired through direct experience. 

Th^ benefits of vocational evaluation conducted under this orien- 
tation are two-fold. First, sinpe the information gathered during the 
course of evaluat ion 'is very similar to that obtained in information 
gatKering oriented programs, there are benefits to be derived from its 
use in subsequent service planting. Second, evaluees themselves de- 
rive direct benefits from evaluation, particularly in the areas of in- 
creased self and occupational knowledge and decision making skills. 
These increases can be directly measured and shouid have a sustained 
benefit on the vocational development and maturity of evaluees. 

Conrner^ \ 

The basic difference between the two process orientations is 
largely a matter of thp pxtent to which the use of occupational 



-3- 




6 



infornSation, provision of fjeedback, and vocational counseling are in- 
tegral p^rts of the ptograrj. The presence or absence* of these compo- ^ 
nents d<spends upon the needs and problems of individual ^aluees and 
specific target groups, the needs, preferences and customs of referral 
sources and agencies, the beliefs and^ values of those operating the 
program, as well as the skills and abilities of the evaluatot^s them- 
selves. , ' 

In an ideal world, the adoption of a pdrticular process orienta- 
tion would depend almost exclusively upon the needs of persons serveH 
by the program. However, in the real world, consideration has to be 
given to the influence of external agencies and individuals who con- 
trol the flow of evaluees inrp the program, and to the beliefs and 
values of those operating the program. Fox* example, the state-federal 
vocational rehabilitation and employment programs are staffed by coun- 
selors who customarily analyze' and synthesize assessment data and use 
it with their clients. They may tend ^ regard an information proc- 
essing oriented vocational eValuation program as usurping or impinging 
upon their profession rale. By contrast, an information processing 
orientation is congruent with career development based educational 
prograihs, and would be' readily accepted by them. 

The beliefs and skills of vocational evaluators tend to follow 
trends which influence choice of process orientations. Evaluation 
programs in the early 1960 *s often regarded vocational^ evaluation as 
an extension of the counseling process but, by the late 1960 *s, the 
trend shifted toward the clinically oriented information gathering ap- 
proach. Currently, there is an emerging trend toward emphasizing the 
counseling component in evaluation (Hutchison, et al., 1975). 

The three way interaction of evaluee need§, referral source cus- 
toms, and evaluator beliefs and skills- in the choice of an evaluation 
process orientation probably produced compromises. Consequently, it 
is likely that individual evaluation program^ may use both process 
orientations and vary their approach .according to the needs of specif- 
ic target groups referred by particular sources . ^ 



/ Content Orientatlonfl 

The content orientation of a vocational evaluation. program re- 
flects the subject matter or topic of .the information generated and/or 
processed during evaluation. There are three dominant orientations . 
toward content: individual characteri^Mcs , specific jobs, and occu- 
pational clusters. Content is closely tied to the specific technolo- 
gies employed in vocational evaluation.' Consequently, reference will 
be made to some of the corno^n vocational evaluation technologife^ in 
the following discussion. ° » 
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Itvidual Characterietice '* 

The information provided by programs with 'an individual charac- 
tervistic* orientation emphasizes those basic underlying characteris- 
tics of^ indiv^iduals (such as aptitudes, abilities, and temperaments) 
which are also required for successful perfomance of most occupations. 
Individuals are assessed in terms of these characteristics and their 
scores or profiles compared to the requirements of occupations to 
identify ihosf occupations whose requirements best match individual 
characteristics. This is, of aourse, the "man- job matching" approach 
which has dominated vocational counseling and testing for well over 
half a century. * ^ 

Jhe individual characteristics orientation is so widespread that 
it is difficult to find a vocational evaluatioa program or a vocation- 
al evaluator without some traces of it. The primary advantage of this 
orientation is its economy. At leas^t in theory, assessment of an in- 
dividual's le^^el of functioning on a relatively small number of char- - 
acfter^tics allows con)arisons to the requirements of a s\ibstantiiil 
number of ©pupations to be made. For example, if evaluees arcas- 
sessed in relation to the six major closes of worker characteristics 
identified in the Dictionary of Occt^ational Titles (U. S. Department 
of LaJbor, 19iB5), their profiles can be coiiq)ared to the requirements of 
over 21,000 occimations, and those which offer the best possibilities 
of success identified. ^ ^ ' 

Several of the available work sample batteries, including tKe.^JEVS, 
McCarron-Dial , Talent Assessment Program, and VALPAR batteries, have 
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been developed^ u^ing an individual characteristics approach,' as have 
most standardized tests such as the General Aptitude Test Battery. 
Standardized psychometrics are often deprecated by vocational evalua-/ 
tors; but this s^^ems to be rooted moi^e in ^ rejection of a "paper and 
pencil" approach to assessment than in a rejection of the underlV>ng 
trait and factor premises used in test development, samples^ 
veloped to assess individual' charac'terjistics are adopt^i^ without 4{ies- 
tion, aXthoug*! psychometrics asses^sing the same characteMstics are 
rejected. However, "paper and Dfencil" measures of certainScharact er- 
istics are adopted and used by/vocational evaluation program^ when 
there. is no convenient altera&fi^ way of obtaining informatiortsabout 
these characteristics, ^ucl^ as iritSlligence , literacy, temperaments, 
and qeeds. 
Specific Jobs ^ 

The information eContent of t*iis orientation relate^ to specific 
jobs or training oppb/turuties found in the local area. Emphasis is 
placed upon the use ybf job analysis to develop "actual job" samples 
wKich use the actual tools, equipment, and\ materials , as well as the 
pro^ction and qU&lity standards, found in the specific target job in 
business and ^itdustry (Experimental Manpower Laboratory, .1970). 

This plantation is fairly widespread in vocational evaluation. 
For exampi^, the TOWER system (institute for Crippled .and Disabled, 
1967) is structured around jobs and training opportunities in New lYork 
City. Similarly, many vocational evaluation programs use job stations 
within the facility or institution, as well /as outside job sites, for 
evaluation purposes. This is a type of specific job evaluation, al-- 
though it is commonly termed "situational assessment" or "job try-out" 

The primary benefit of this orientation is that it most closely 
approximates the widely held belief that the be^ way to tell whether 
or not people can do a .job is to place them iirto the job and see if 
th^y can do it (Wernimont and Campbell, 1968). S^e the actual job 
(or a close simulation of it) and its. related performance standards 
are used as criteria, \chis priantatioi^ is thought to produce the best 
information about probabili*ties of sxicc^ess in SpeciVc job or training 
placement*^. ^ ^ ' — * 
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Occupational Clufitere 

t' 

The information content of this oz^ientation related to broad 
clusters of specific jobs and occupations grouped together on the ba- 
sis of certain conraqn factors', such as subject matter, products, work 
fielda, materials, or industries. Th<! assumption underlying the oc-k 
cupational clusters approach is similar to that of the individual 
^characteristics .approach. However, rather than ^closing upon charac- 
*^teristics of individuals, the occupational clusttrs orientation fo- 
cuses upon the work tasks conmonly performed in gloups of jobs and oc? 
cupations. These con^nly performed work tasks afle identified for 
specific occupational clusters ,and methods for assessing performance 
•of these tasks developed^' for the vocational evaluation program. 

Two occupational clustering systems have received substantial use 
in vocational evaluation programs. The system used in the IHctiorutry 
of Occupational Titlee clusters occupart4ons on the basis of a three 
digit code.« The first digit designates ^one of j:en major occupational 
categories, while the second and third digits provide an increasingly 
detailed and specific grouping. The Singer vocational evaluation sys*- 
temy for example, is based on two digit occupational divisions fron^ 
the b^ctionary of Occupational Titlee, * 

second major occupational clustering system is the Office of 
Educ£^tk)n System. This system groups occupations into^. one of fifteen 
major clusters based on the similarity ^f subject jnatter or^knowledge 
content. \The Office of Education .classif/,i:atian system is not as 
highly developed or consistent as that us^d in the Dictionary of Occu-^ 
pationat Titlee and' the detailed information abc^t specific jobs and 
occupations writhin clusters available in the lattei? is lacking. Howt 
ever, {he subject matter-knowledge bas6 of the system lends itself to 
education and training applicatiorts. Additionally, a ^ubstantial num- 
ber of audio-visiMl occupational information resources based on the 
Office of. Education occupational clusters have been developed which' 
can be used in vocational evaluation programs. 

Other oxrcuparional clustering systems^ave* been developed l^ut 
have not as yet received any substantial application in vocational 



evaluation. Th^ Bureau of the Census occupation classification system 
and the industry-qccupation matrix of the Bureau of Labor Statistics 

* are two for which an extensive amount of information about , the charac- 

* - teriotics and earnings of workers are available, but thus far are un- 

explored in tepins of the ir^ potential utility to vocational evaluation 
programs . . 

The occupational cluster orientation is not as widely used as ei- 
ther of the other two ^"content ^orientations , 'However, reconmendations 
relating to broad clusters of occupations, such as clerical or food * 
service work, ^are often encountered in practice', suggesting that it is ^ 
used by e valuators . The primary advantages of these orientations are 
that' it stakes intQ account that (a) individuals are muitipotentialed 
and can be successful in a number of specific jobs and occupations 
(Super, 1957) and (b) the depth or specificity of the vocational deci- 
sions to be made subsequent to vocational evaluation services varies 
depending upon the age and stage of vocational development of the 
evaluees (Writes, 1969; Korn, 1975; Super, 1957). The occupational 
cluster orientation is probably most appropriate in vocational- evalua- 
tion programs which deal wi^^adolescents or individuals with delayed 
or impaired Vocational development who require- a remedial or compensa- 
■ tory experience (LoCascio, 196^1). 

Corment ' \ 

The adoption of a particular content orientation can be influ- 
^ enced by external sources, as was the case with tKe process orienta- 
tions. The widespread belief in the individual characteristics ap- 
proach among persons in human services creates a natural predilection 
in its' favor. Additiona?.ly , as was suggested in, the "Rescript ion of 
the occupational clusters orientation, the adopt iofftjf particular con- 
tent ori^enta^ions depends 'in part upon^Jhg nature of the vocational 
decisions to be made subsequent to vocational evaluation. These deci- 
sions can vary depending upon the characteristics and needs of persons 
se^rved v/ithin the program. In general, however, younger individuals 
1^ who are in school or in the school, to^work transition make "career de- 
cisions related to occupatipnal clusters, while older individuals make 
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decisions related to specific jobs. Knowledge of individual charac- 
, teristics, particularly changes in characferist^cfe which may have oc- 
curred subsequent t;o acquired disability, is often useful information 
for vocational decision making. Consequently, ap evaluation program 
which serves a homogeneoas target population may be characterized by 
a single content orientation while one w|iich serves a heterogenous 
target population made up of several distinct groups, considering age. 
disability, vocational maturity, and expected outcomes, may use all of 
^ the content orientations. 

Although content orientations are dependent upon the hardware 
available in l;he program, there are software ^hodif ications whi^h can 
be made to allow th^same hardware to-be used for all of tJte content 
orientations. An example of possibU ^OJftware modifications is^pro- 
vided by the GeneraA Aptitude Test Ba|tteijy (U. S. Department of >Labor^ 
1970). The GATE provides an assessment df individual characteristics, 
specifically nine aptitudes. HoweverL oJcupational Aptitude Profiles 
for small clus^ters of occupations can be^^ developed using established^ 
cutting scores on certain combinationi p'f^aptitudes for >jBach of these 
clusters, Similarly, through the use 
individual subtests from the GATB, Sped 

(SATB's) can be developed to assess individuals in relation to specif- 
ic jobs. This use of different norms dind subtests provides- bonsidera- 
^ble flexibility in the use of^the GATE to meet different information 
content needs. This flexibility, has not been eqialled to date in ex- 
isting available vocat^al evaluation materials i 

. " Implications for Prpiram^ PlanJ^ng, 

Development, and |Evaluatloti / 

The discrete process and content orientations have a niimber of 
implications for vocational evaluation program planning, ^development , 
and evaluation which are discussed in this\ section. 



Df established combinations of 
Lfic Ap"titujj[e Test Eatteries ^ 



Fvo^^q^ Planning ^ » 

A program is made up of both process and content, so that two 
procpsp and three content orientations can be combined to form the *six 
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b^slc typt^^s of vocational evaluation progi^ams shown in Table K In 
other words, dt an operational level* it is more accA^te to describe 
a voybational **v.iluat ior* pi^ogram inS^ienns of its specif ic process -con- 
tent oriental ipn or oriental ions,* than to merely ^ate it iis "voca- 
tional evaluation", ^ ^ 

Tablf 1. Basic Types of Vocational Evaluation Programs^ 



Proceps' 
Orientation 




1 

Content Orient^ti 




1| Indivtidual 
Characteristics 


Specific 
Job 


pu , 

'(Occupational 
Clueter 


Infonnation 
Gathering 








Information 
Processing 




■ * « 





^ The adoption of any process-content approach is influenced by 
"three sources : )clients3[ referral soui^ces, and staff. A program may 



use several appr'oaches d(i(>ending upon the way these factors interact 
witK different .iii>:r^ut : of evaluees. Tor example, an information 
gathering-s^eci f i c jjpb apf'roach might be used with state rehabilita- 
" tion agency referrals' who have prior work experience; an information 

rmi r'.:;in^*- individual characteristics approach used with hospital re- 
>(J f errals having newly acquired physical disabilities; and an informa- 
tion process ing-occupatTohal clusters ^proach used with in-school ad^ 
descents referred by educational instituticims. In fact, the primary 
limitations upon the diversity of specific approaches which could be 
us e^ within a vocational evaluation program stem fcom the capabil'it ies 
of staff to accomodaAs to tjhe requirements of specific approaches and 
the availability of i^ sources to support each apptoacif. These limita- 
ti<bns are^ discussed in nore detail in the next section. 

it is apparent that a considerable amoiAt of flexibility is * 
available to program planners. Rather than attempting to pursue the 
will of the wisp single, ''correct'* way to evaluate all clients, atten- 
tioni should be ^Jven to developing programs which are accomodated to 

I* 
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the needs and characteristics of specific subgroups hf evaluees from 
particular referral sources . This approach requires that planners ob- 
tain information ab(«; the operations 'and expectations of "referring 
sources, as w^l^a 'iflformation about the needs and characteristics of 
evaluels they( typically refer. Although the information iibout refer- 
ral^sources can generally be obtained without too much difficulty, 
agency record keeping systems conmonly do not contain the systematic 
and details^ information about ilndividual characteristics which \s 
necessary for accurate program planning. The besr approach in this 
situation is to begin operating the vocational evaluation program on a 
"best guess" basis and modify or fine 'tune it later as the necessary 
evaluee data become available (usually from program ™ther than refer- 
ral source records ) . - 

Program Development 

The capacity of staff to accomodate to the requirements of spe- 
cific approaches and the availability of material resources necessary 
to support these approaches set limits upon the extent to which vari- 
ous process-content orientations can be successfully used with a pro- 
gram. These limitations can be overcome through active program devel- 
opment . 

* e 

It is usually a straightforward matter to reoruit, and/or tt'ain 
staff who can use the information gathering-individual characteristics 
and information processing-occupational clusters^^ientations . These 
two correspond closely to approaches conmonly tauW in psychology, 
cowseling. and vocational evaluation programs so t>.at individual's 'fa- ^ 
miliar with them can be directly recruited, or needed training ob- 
tained within the local area. In-service and-^the-job training may 
have to be provided. to develop staff abilities"^ use other ap- 
proaches. * \ 

An unanswered question in the area of staff development is the 
extent to which indivixiual staff members can shift gears and success- 
fully use a variety of approaches. This may not be a problem in larg- 
er vocational evaluation programs which can afford the luxury of 
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"specialist" cvaluators who uao only one or possibly tno diotindt ap- 
proaches to evaluation. It -can be a problem in smaller programs where 
there are only one or two-devaluation staff. These individuals liwiy t^t 
be able to accomodate to the different requirements of each approach, 
even with training. Consequently, smaller programri may have to spe- 
cialize In only those distinct approaches to evaluation which can be 
successfully used by the staff, and would screen and accept only those 
referrals who would benefit from thedapproifch used in the program. 

The second aspect of program development has to do with the mate- 
rial resources •and technology necessary to suppc^rt the fr^am. This 
includes both hardware, such as work samples. Job atatlpn^, aj\d other 
materials, and software, such. as the delivery aysteno for spccifiQ 
seryices. ^ 

'There is a considerable amount of proprietary hardware available 
which can be used in vocational evaluation programs. This material ia 
co«»only usable in programs with specific process-content orientatlonSi 
as is indicated In Table 2. It is evident that moat of the available 
work sample sysfUjs fit into the information processing-individual 
oliaracteristics approach. This seems to reflect a widespread assump- 
tion thajc vocational evaluation is an alternative method of psychomet- 
'ric assessment for certain segments of disabled and. disadvantaged tar- 
get populations* It can be observed that those materials which are 
most wi'dely used in educational programs! such as the Singer system. 
IJroject Discovery, and occupational information materials, fit within 
the information processing-occupational' clusters apprbach. This goes 
along with the exploratory, career development thrust of contemporary 
educational progranming. 

» There is an obvious lack of materials suitable for use with some 
of the process-content orientations, suggesting that evaluation pr<5- . 
grams which adopt these )^pproaches will have to engage in extensive 
developmental activity ^efore they become fully operational. -Materi- 
als development activities for these orientations include gathering 
detailed job analyses of positions in the local econoiry, creation of 
new work samples or use of community job stations, development of ad- 
ditipnal norms for existing mater^ls, and production of local 



occupational Information roaourcoa. Dolivory ayatcm devolopmont might 
include tho addition of foodback and knowledge of re.ulta procodurea, 
iDtogratlon ot occupational Infornation Into tho -Evaluation proceao. 
and devolopmont of alternative reporting procedurea. ) ' 

Table 2. Primary Proceaa and Content Orientationa of Selected 
Proprietary Vocationa; Evaluation Syotema and Haterialo 



Procujia 
Orientation 


Content Orientation 


Individual 
Characteristics 


Specific 
Jobs 


« 

Occupational 
Clusters 


Information 
Gathering 
' 1 


iruQ 

wu VO 

McCarron-Dial 

Psychometric 
Tests 

Talent Assessment 
Program 

VALPAR 




WREST 


Infonnaticn 
Processing 


Occupational 
Exploration Kit 


Job Experience 
Kits 

Print £ non-print 

occupational 

information 

Project Discovery 

TOWER 


Print 6 non-print 

occupational 

information 

Project Discovery 

Singer 



Program Evaluation 

V , 

This i$ an increasingly Important component in vocational evalua- 
tfon ^^ogram^^g, Identification of specific approaches to vocational 
evaluation, stated in terms of jsrocess and content orientations, which 
are used with Qvaluees is a valuable aid in program evaluation. 

Each specific approach to vocation.?! evaluation has a unique set 
of goals and objectives, as well as methods of measuring goal attain- 
ment -and benefits. In other words » a content orientation provides a 
broad statement of purpose (information gathering or processing) , from 
which increasingly '^tJocific goals and objectives can be derived. A 
content or|entation» indicating the nature of the information dealt 



-13- 



ERIC 



16 



V 



^lt*i, clarifies and.makos more specific the goals an^ objectives de- 
rlvcd^fFofev^ process orientation. Consequently, knowledge of the 
process and content approach used with a particular piOpram pr with « 
particular subgroup of evaluees within a program aids IH the conceptu- 
alization and development of a program evaluation procedure. 

The process and content orientations are alao useful in opera- 
tlonalizing a program evaluation system. At this level, a process 
orientation indicates who obtains the primary benefits fro« evaluation: 
referral sources (in the case of the infonMtion gathering orientatioi* 
or evaluees^in the information processing orientation). Thus, proc- 
ess orientation identifies the source of program evaluation data. 
Content orientation specifies ttje specific data to be obtained from 
the source: indications of changes, increases, or decision making 
relative to individual chairacteristics'; specific jobSy W occupational 
clusters.* I^n other words, the conten,t onlentation indicates what has ^ 
to be measured while the px<c>oe£5s prientaUon indicates who does the^ 

measuring. / V 

these applications dlP^.tHo pro^ess/^nd content orientations are 
basic and straightforward.' However, they also serve to illuminate 
some practical problems U;> the>valuation of vocational evaluation 
programs. (S* • . 

First, it it unli<;bly that a single generic approach to program 
evaluation could be ^^V'eloped which would be an accurate indicator of 
the overall ef fectiV^ifloJis of a program, or which would allow Compari- 
sons between progra^'.to be made. It has already been noted that it 
would be unusua; to.^lnd a program which uses a single process -content 
approach; rather there would bfc different approaches used depending 
upon the nature of target groups, referral sources, and staff- Since^ 
each approach has a relatively unique program evaluation procedure at- 
tached to it, the?5e separate procedures roust be used with those eval- 
uees and/or referral sources who receive a specific approach. In oth- 
er words, an attempt to aggregate all* individuals who received eValu-- 
ation services, 4w/thout controlling for the type of evaluation services 
received can ^e4^1t in important 'benefits being missed. Also, 



aignif leant unique benefits obtained by a small number of porspns who 
receive a particular type of evaluation can be buried in the midst of 
data obtained from a larger number of persona who noceived other types 
of evaluation services. 

This problem is important to consider at the facility level, but 
it also arises in program evaluations conducted by referral agencies 
at the district, state, and national levels. The detailed knowledge 
of evaluation approaches used by local individual facilities is often 
lacking among referral agency program evaluators and it is easy Tor 
them to make the assumption that "a vocational evaluation is a voca- 
tional evaluation is a vocational evaluation". The result is a gener- 
ic program evaluation procedure blindly applied across all facilities 
without consideratioji for the specif ic approaches used by individual 
facilities. Again, the problem is that specific benefits for a small 
number of persons who receive a particular type of evaluation can be 
overlpoked or lost in a mass of data from individuals who receive oth- 
er types of evaluation services. The temptation (o compare programs 
to one another to determine "the most effective" is great, but it can 
be cdllfletely misleatjling unless the process-content orientations to- 
ward vocational evaluation are equated before the comparison is made. 

There an additional problem with both the information g^ther- 
ing-process orientatioh and the iridivtdual characteristics-content 
orientation which can be merftioi\ed. Program evaluation can document 
increases in information, changes, or the availability bf .previously 
unknown information for these two^ordentatjons. Hoy^ver, there are no 
practical and economical techniques for measuring .the utility of this 
..information in decision malting and service planning. Some approaches 
to utility measurement have been suggested (c.f . Cronback and Gleser, 
1965; Lee, 1971) but these requir^ extensive data and have been ap- 
plied only in restricted research situatiqns.- The inability of voca- 
tional evaluation programs using \hese two ori^entations to demoni3tj»ate 
the utility of the new, additional, or otherwise unavailable informa- 
tion they generate is a definite problem in an era of accountability. 
It is important to recognise that the same problem arises with othet* 
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services, for cxiiple medical examinations and psychologic£tt<tJ!5ting. 
In the latter two cases « however, the' utility of the information^ 
gained is taken for granted and physicians and psychologists are n6t * 
required to evaluate the effects of their services by measuring utili- 
ty. It will "be iiUerfSting to see if vocational evaluatiorT services 
are accorded the same treatment. 



Although there are oone broad general assumptions « beliefs » and , 
practices underlying the delivery of vocational evaluation services, i 
the actual operation of vocational evaluation programs appears to be \ 
guided by orientations toward program process and content. A knowl-* 
edge of these process and content orientations ei^lai^s soae of the 
apt)arent diversity aaong existing vocational evaluation programs -and 
has implications for program planning, development, and evaluation. 

Two dominant process orientations, information gathering and in- 
formation processing, can be identified, as can three content orienta- 
tions, individual<5^dharact eristics, specific jobs, and occupational 
clusters. Since a progi^m "consists of both process and content, the 
specific process and content orientations combine to form six basic 
approaches to vocational evaluation progx>aMing« 

The selection of any particular approach is dependent upon sever- 
al factors including the needs and problems of the targetjpopulation, 
the needs and expectations of referring sources, and tHe beliefs and 
skills of evaluation staff* 1} is possible for a vocational evalua- 
tion program to be characterized by a single approach if it serves a 
homogeheous target group from a single referral source. However, 
since most programs serve several ^djlstinQt target groups and muAi^^e 
referral sources, they will be characterized by^everal approaches to 
evaluation. This fact has to be taWen into account in program plan-^ 
ning. 

' Program development has to take into account the dnique delivery 
system and material resource needs of each approach used in the pro- 
jgramp Staff have to be able to use each approach in«the program, 
which has implications for recruitment and staff development. 
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Sljpilarly, available nuterial resources may have to be modiAed to f\ 
particular approaches, o^* new materials developed to meet specific' 
program needs. ' 

Lastly, the process and content orientations have implications 
for program evaluation. Each approach^has a relatively unique set of 
^oals, objectives, information sources, and means of measurewsnt. A 
generic approach to program evaluation, applied across all approaches 
within a program or across a number of programs used by a particular 
referral Source, can lead tt) a significant loss of information regard- 
ing benefits from specific approaches. Similarly, it may lead to mis- 
leading comparisons ^between individual programs. 
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